Papers with WMT16 En-Ro benchmark
Binary and Ternary Natural Language Generation (2023.acl-long)
Copied to clipboard
| Challenge: | ternary and binary neural networks have proven difficult to optimize since both parameter and output space are discretized . authors demonstrate ternaries and binary models on downstream tasks of summarization and machine translation . |
| Approach: | They propose to use ternary and binary neural networks to optimize for multiplication-free computation . they propose to apply statistics-based quantization for the weights and elastic quantization of the activations to the transformer text generation model. |
| Outcome: | The proposed model outperforms the best existing models on machine translation tasks. |